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nKPKA'I'ED  MEACUHKMIlNTS  designs,  J! 

By 

A,  Hedayat  and  K,  Afsarinejad 

1 . Introduct i and  the  Need  for  Repeated  Measurements . 

Experimenters  in  many  fields  of  research  perform  experiments 
designed  in  such  a way  that  each  experimental  unit  (subject) 
is  assigned  more  than  once  to  a treatment  (test),  either 
different  or  identical.  These  designs  are  given  several 
names  in  the  literature  of  statistical  designs:  repeated 

measurements  designs  (briefly  RM  designs),  crossover,  or 
changeover  designs,  (multiple)  time  series  designs,  and 
before-after  designs.  An  extreme  form  of  an  design 

is  the  one  in  which  the  entire  experiment  is  planned  on  a 
single  experimental  unit.  Details  on  latter  designs  can 
be  found  in  V/illiams  (1952),  Finney  and  Outhwaite  (1956), 
and  Kiefer  (i960).  A brief  history  of  the  subject  with  a 
bibliography  containing  156  directly  related  references  is 
given  in  Hedayat  and  Afsarinejad  (1975)- 

The  use  of  HH  designs  rather  than  the  classical  de- 
signs, for  which  the  number  of  experimental  units  is  the 
same  as  the  number  of  observations,  can  be  Justified  in 
many  settings  such  as  when: 

(1)  One  of  the  objectives  of  the  experiment  is  to  determine 
the  effect  of  different  sequences  of  treatments  applications 
as  in  drug,  nutrition,  or  learning  experiments. 
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(ii)  The  exporimenters  might  be  interested  in  discovering 
whether  or  not  a trend  can  be  traced  among  the  responses 
obtained  by  successive  applications  of  several  treatments 
on  a single  excerimental  unit.  For  example.  If  one  wants 
to  measure  the  degree  of  adaptation  to  darKness  over  time, 
the  most  efficient  use  of  subjects  requires  that  each  sub- 
ject be  tested  at  all  times  of  interest. 

(iii)  Experimental  units  are  scarce  and  have  to  be  used  re- 
peatedly. This  is  often  the  case  in  small  clinics  or  in 
the  development  of  large  military  systems,  such  as  aerospace 
vehicles,  airplanes,  radar,  computers,  etc. 

(iv)  The  nature  of  the  experiment  is  such  that  it  calls  for 
special  training  over  a long  period  of  time.  Therefore,  to 
minimize  cost  and  time,  the  experimenter  should  take  advant- 
age of  the  trained  experimental  units  for  repeated  measure- 
ments . 

To  this  point,  RM  designs  have  been  used  on  the  grounds 
of  balance  and  simplicity  of  computations.  While  such  cri- 
teria may  still  be  attractive  in  some  cases,  they  cannot  be 
Justified  on  statistical  grounds.  This  paper  shows  that  some 
families  of  RM  designs  which  are  very  popular  among  experi- 
menters are  "universally  optimal"  in  a relatively  large  class 
of  competing  designs  (Section  3.1).  Existence  and  nonexistence 
of  such  designs  are  discussed  in  Section  3.2. 
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2 . Prellmiiiarj  es  and  Universal  Optimality  . 

The  search  for  an  optimum  design  involves  the  determination, 
in  a specified  class  of  competing  designs,  of  the  designs 
which  is  best  according  to  some  well-defined  criterai  under 
a given  model  for  observations.  In  this  paper  we  are  con- 
cerned exclusively  with  the  following  set-up:  t treatments 

are  to  be  tested  and  studied  via  n experimental  units. 

Each  experimental  unit  is  used  in  p periods  resulting  in 
r^  > 1 observations  for  the  1-th  treatment,  r^  + rg  +...+r^  = np. 
Clearly  there  are  1 1 ( t ^ ways  of  performing  the  ex- 
periment. Let  D denote  the  set  of  all  such  arrangements, 
to  which  we  shall  refer  as  designs.  If  d is  a design  in 
D,  then  let  d(i,j)  denote  the  treatment  assigned  by  d in 
the  i-th  period  to  the  j-th  experimental  unit.  Throughout 
this  paper  the  following  model  is  assumed  for  the  response 
obtained  under  d(i,j): 

(2.1)  . u 4 

i==l,2,.,,,pjJ=l,2,...,n 

Pd(0,j)  = 0 for  all  J, 

where  the  unknown  constants  u,  a^,  j) 

are  respectively  called  the  overall  mean,  the  effect  of  the 
i-th  period,  the  effect  of  the  J-th  experimental  unit,  the 
direct  effect  of  treatment  d(l,J)  and  the  first  order 
residual  effect  (or  carryover  effect)  of  treatment  d(i-l,J). 
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We  assume  that  homoscedastic  which  means  zero. 

We  are  interested  in  specifying  a design  d in  D which 
Is  connected  with  respect  to  all  contrasts  in  immediate  and 
residual  effects  and  is  "universally  optimal"  in  a speficied 
class  of  competing  designs. 


2.1.  Universal  Optimality.  In  vector  notation  the  np 
responses  under  Model  (2.1)  can  be  written  as 


Where  9^  consists  of  paramters  of  interest  for  study.  In 
our  case,  0^  consists  of  direct  treatment  effects  or  residual 
effects  or  both.  Let 


^Id^ld 


^ld^2d 


^2d^ld 


and 

Qd(®l)  = ■ ^id^2d  ^^2d^2d^  ^2^d 

then  is  the  information  matrix  associated  with  9^ 

since  it  is  well  known  that  a linear  parametric  function 

i t 

? = ^ 0^  is  estimable  under  d if  ■*  is  in  the  row  space 

of  C,,  and  the  best  linear  unbiased  estimator  of  f is 
d 

given  by 

% = with  Var($)  = I . 

In  this  case  we  say  d is  connected  for  ?.  Now  suppose  d 

is  connected  for  a set  of  t-1  independent  orthonormal 

$ 

contrasts  A 9^.  Then  by  the  above  argument  the  covariance 

i 

of  the  best  linear  unbiased  estimator  of  A is  given  by 

= A C'Aa'^  = (A  C^A)  . 


^ } 
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This  leads  to  consideration  of  an  optimality  functional  Y 
on  (t-1)  X (t-l)  matrices  and  to  determination  of  a design 
d which  minimizes  Some  commonly  used  optimality 

criteria  are: 

D-optimality : = Det 

A-optimality : = Tr  V^; 

E-optimality:  = maximum  eigenvalue  of  . 

The  relationship  between  these  optimality  criteria  is  well- 
known  and  may  be  found  in  Kiefer  (I958,  1999,  1975).  In 
some  settings  it  is  possible  to  introduce  an  optimality 
criterion  which  include  D-,  A-  and  E-optimallty  as  special 
cases.  One  such  setting  together  with  a sufficient  condi- 
tion under  which  a design  is  optimal  is  given  by  Kiefer 
{1975)  and  will  be  utilized  throughout  this  paper. 

A major  difficulty  is  the  computation  of  (A  C^A)'^  for 
each  competing  design  d.  Since  in  our  case,  as  will  be 
seen  later,  each  row  (hence  each  column)  uf  adds  up  to 

zero,  we  can  utilize  the  recent  result  of  Kiefer  (1975)  on 

/ __*l 

universal  optimality  and  avoid  the  computation  of  (A  C^A) 
for  each  d.  We  shall  now  briefly  review  the  concept  of 
universal  optimality.  Suppose  that  consists  of  t x t 

non-negative  definite  matrices.  Let  consist  of  those 
elements  of  R^,  all  of  whose  row  and  column  sums  are  zero. 
Let  n be  the  set  of  all  functions  UJ  from  to 

(-00,  +00]  with  properties: 


ft 
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(i) 

m(.) 

is  convex. 

(2.2) 

(11) 

UJ(bR) 

is  non- increasing  in  the  scalar 
b > 0,  R e . 

(111) 

m(  .) 

is  invariant  under  permutation  of 
rows  or  columns  of  R e R^ . 

In  our 

setting 

^d  ^ 

Rf 

A very  useful  concept  of  optimality  in  this  setting 
is : 

* 

Definition  2.1.  A design  d is  universally  optimal  in  the 

class  of  competing  designs  under  consideration  if 

uj(C^*)  ^ each  u)  e D. 

* 

If  d is  universally  optimal,  then  it  is  D-,  A- , and 

t 

E-optimal.  In  some  situations  it  is  possible  to  identify 
the  universal  optimal  design  without  actually  computing 
lu(C^)  for  each  d.  One  such  situation  has  been  identified 
by  Kiefer  (1975)»  and  is  formally  stated  here.  First  we 
need  the  following  definition. 

^efinitio_n__2  .£,  A design  d is  said  to  be  completely 
symmetric  with  respect  to  0^  if  its  corresponding 
is  of  the  form  al^  + where  a and  b are  scalars, 

is  the  Identity  matrix  of  order  t and  is  the 

matrix  of  order  t whose  entries  are  all  one's. 

Theorem  2.1.  If  the  class  of  competing  designs  contains  a 
* 

design  d such  that 


-7- 
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\ 


i, 

i 


(i)  d is  completely  symmetric, 

(ii)  TrC^*  > TrC^,  for  all  d e R^, 

* 

then  d is  universally  optimal. 

In  the  following  sections  we  have  characterized  univer- 
sally optimal  designs  in  some  classes  of  competing  designs 
which  we  know  are  connected  for  the  parameters  under  considera- 


tion. 


■5 . Universal  Optimal  Repeated  Measurements  Designs . 

In  this  section  we  shall  search  for  a universally  optimal  j 

design  (if  it  exists)  in  a class  of  uniform  RT4  designs.  I 

The  existence  and  nonexistence  of  such  optimal  designs  are 

studied  in  the  final  part  of  this  section.  First  we  need  ' 

some  notation  and  definitions.  An  arbitrary  RM  design 

based  on  np  observations  resulting  from  the  application 

of  t treatments  to  n experimental  units  during  p periods  ■ 

is  denoted  by  RM(t,n,p).  The  set  of  all  such  arbitrary  RM 

designs  is  designated  by  Fm(t,n,p).  Our  study  here  is  limited  j 

to  the  case  where  p = t and  n = Xt,  X a positive  integer.  'i 

J 

Definition  ^.1.  A design  d in  fi^ti'(t,n,p)  is  said  to  be  i 

/ / i 

uniform  on  the  experimental  units  if  d(i,j):|=d(i,j),i4=i  i 

for  all  j . 


Definition  3.2.  A design  d in  RIti(t,n,p)  is  said  to  be 
uniform  on  the  periods  if  in  each  period  d assigns  the 
same  number  of  experimental  units  to  each  treatment. 


Definition  A design  d In  am(t,n,p)  is  said  to  be 

uniform  if  its  is  uniform  on  both  the  experimental  units 
and  periods. 

The  subset  of  all  uniform  designs  in  '’Tr'(t,n  = Xt,t)  is 
denoted  by  U<?T»'(t,Xt,t)  . 

3.1.  Search  for  a Universal  Optimal  Design  in  U9. fn ( t , X t , t ) . 

Our  interest  here  mainly  lies  in  unbiased  estimation  of 
linear  parametric  functions  of  direct  treatment  effects  and 
residual  effects  under  Model  2.1.  So,  under  the  notation  of 
Section  2.1,  the  parametric  vector  9^  consists  of  either 
all  direct  effects  or  all  first  order  residual  effects.  The 
information  matrix  associated  with  the  entire  set  of  para- 
meters of  Model  2.1,  rewritten  as 
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r 


i. 


whe  re 

I is  the  identity  matrix  of  order  t, 

is  the  incidence  matrix  of  direct  effects  and  first 
order  residual  effects  under  d, 

is  a square  matrix  of  order  t with  all  entries  ones, 
Jg  is  a t X n matrix  with  all  entries  ones, 

1 is  an  r X 1 vector  of  ones, 

is  the  incidence  matrix  of  first  order  residual  effects 
and  period  effects  under  d, 

N,  is  the  incidence  matrix  of  first  order  resdiual  effects 
d 

and  experimental  unit  effects  under  d. 


Lemma  ~^.l.  The  information  matrix  of  the  joint  direct  treat- 
ment effects  and  first  order  resdiual  effects  is  given  by 


(3.2)  C.(T,o)a 


-2 


nl  - \J, 


Proof . If  we  write  partloned  in  (3.1)  in  the 


-2 


following  way 


^Id^ld 


^2d^ld 


^ld^2d 


^2d^2d 
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then 


(3.3)  C^(T,p) 

where 


^M^ld  ■ ^Id^Zd  *^2d^2d^  ^2d^ld 


nl 

^2 

^^2 

0 

i 

■’2 

tl 

"^n 

= 

0 

/ 

tl 

n 

nt 

0 

0 

0 

. , 

_ 

_ 

<W2d)'  - 


After  some  algebra  (3.3)  reduces  to  (3.2). 


t 

t 

jil 

i 

< 


Theorem  3.1.  A design  d In  1iRtn( t,Xt ,t)  Is  universally 
optimal  for  the  estimation  of  direct  treatment  effects  if 
Md*  = X(Ji-I). 

Proof.  Utilizing  the  Joint  information  matrix  of  the  vector 
of  direct  treatment  effects  and  residual  effects  as  given  in 
(3.2),  one  can  derive  the  information  matrix  of  the  vector  of 
direct  effects  as 

t 


(3.4)  C^(T)  = nl  - 


X(t^-t-l)  ^ ^ t^-t-1  ^ 


It  can  be  argued  that  for  any  d in  Uffm(t,Xt,t) 


and  therefore 


Md^i  = = Ut-l)Ji 


Ch(OU  = 0 , 


meaning  that  the  sum  of  the  entries  in  each  row  and  column  of 
C.(t)  is  zero.  Therefore,  by  Theorem  2.1,  a design  d*  in 


U9Tt\(t,Xt,t)  jG  universally  optimal  if  (t)  is  completely 

symmetric  and  TrC^*(T)  ^ TrC^(T)  for  any  other  d in  the 

class.  Clearly  is  completely  symmetric  if  d is 

such  that  = X(J^-I).  From  the  expression  for  C^(t)  it 

is  obvious  that  TrC^(x)  is  maximum  if  and  only  if  TrM^M^ 

is  minimum.  But  since  the  sum  of  each  row  of  is  X(t-l) 

/ 

TrM^M^  is  minimum  if  and  only  if  = x(Jj^-l). 


Theorem  3.2.  A design  d in  uRtn(t,\t,t)  is  universally 
optimal  for  the  estimation  of  first  order  residual  effects 
if  = X(J3^-I). 

Since  the  information  matrix  of  ther  first  order  resi- 
dual effects,  C^(p),  from  (3. 2),  is 

(3.5) 


c^(p)  . - 

t 


the  proof  is  analogous  to  the  proof  of  Theorem  3.1. 

The  problem  of  the  existence  and  nonexistence  of  a uni- 
versally optimal  design  in  uS*tn(t,Xt,t)  will  now  be  studied. 


3.2.  Exlste nc e_ _and_  ^ nexistence  of  a Universal  Optimal  De- 
sign in  U9Tn(t,\t,t) . 

First  we  shall  give  a combinatorial  interpretation  of 
the  structure  of  a design  in  URrn(t,Xt,t)  whose  incidence 
matrix  of  direct  treatment  effects  and  first  order  resdlual 
effects,  is  of  the  form  X(Jj^-l).  Then  we  shall  invest! 

gate  the  existence  and  nonexistence  of  such  designs.  First 
we  need  the  following  definition. 
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Deflnitlon  4.1.  A design  d In  U<?!T\(t,Xt,t)  is  said  to  be 
balanced  with  respect  to  the  set  of  direct  treatment  effects 
and  first  order  residual  effects  if  in  the  order  of  applica- 
tion each  treatment  is  preceded  \ times  by  each  other  treat- 
ment, i.e.,  the  collection  of  ordered  pairs  (d(i,J,),  d(i-l,J)), 
1 ^ i ^ t-1;  1 ^ j ^ \t  contains  each  ordered  pair  of  distinct 
treatments  precisely  \ times. 

If  d satisfies  the  above  requirement  we  shall  simply 
say  that  d is  balanced. 

Example  4.1.  Let  t = 3 and  X = ^.  Then  the  following 
design  is  balanced. 

Experimental  Units 


_1_ 

2 

3 

_.jL 

5 

6 

7.. 

_.8_ 

__9 

10 

_11^ 

-12 

1 

1 

2 

3 

2 

3 

1 

1 

2 

3 

2 

3 

1 

Periods 

2 

1 

3 

1 

2 

3 

1 

2 

3 

1 

2 

3 

1 

2 

1 

2 

3 

1 

1 

2 

3 

2 

3 

1 

1 

2 

3 

Lemma  4.1. 

^d 

is 

of 

the  : 

form 

x(Ji 

-I) 

if 

and 

only 

if 

d 

is 

balanced,  i.e.,  d is  universally  optimal  if  it  is  balanced. 

The  proof  follows  directly  from  the  definition  of  first 
order  residuals  effect  in  Model  2.1  and  the  fact  that  under 
the  stated  condition  the  diagonal  entries  of  are  zeros 
and  off  diagonal  entries  are  X. 


^ J*  * ^ 
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If  is  a balanced  RM(t,X^y,t)  design,  1 = 1,2,  then 

by  patching  d^  and  dg  side  by  side  we  shall  obtain  a 
balanced  RM(t,\t,t)  design  with  X = + Xg.  Therefore 

to  construct  a balanced  RM(t,Xt,t)  design  it  is  sufficient 
to  study  the  existence  of  a balanced  RM(t,t,t)  design. 

But  it  should  be  clear  that  if  a balanced  RM(t,t,t)  design 
does  not  exist  then  we  cannot  conclude  the  nonexistence  of 
balanced  RM(t,Xt,t)  designs  with  X > 1,  as  we  shall  see 
short ly . 

Several  authors  have  studied  the  existence  and  nonexist- 
ence of  balanced  RM(t,t,t)  designs  either  directly  in  the 
context  of  experimental  design  or  in  algebraic  systems  equi- 
valent to  such  designs.  For  an  extensive  bibliography  on 
the  subject  the  reader  is  referred  to  Hedayat  and  Afsarinejad 
(1975).  Here  we  shall  up-date  the  information  on  balanced  de- 
signs given  in  Hedayat  and  Afsarinejad  (1975). 

Family  One . t = 2m,  X = 1 

It  is  known  that  balanced  RM(t,t,t)  designs  exist 
for  all  values  of  m.  For  example,  if  we  number  the  experi- 
mental units  and  periods  by  0,l,...2m-l,  then  d is  balanced 
if  d assigns  treatment  d(i,j)  in  the  i-th  period  to  the 
j-th  experimental  unit  in  the  following  way: 

d(l,j)  = (-|)  + J ®od  2m  if  1 is  even 


) + j mod  2m  if  1 is  odd. 


Family  Two,  t = 2m  + 1,  X = 1. 

It  is  known  that  no  balanced  RM(t,t,t)  design 
exists  if  t = 5,5,  or  7-  According  to  E.  Sonnemann^  the 
following  design  for  t = 9 was  found  via  an  electronic 
computer  by  K.  D.  Mertz. 


Periods 


Experimental  Units 

23456 7_ 


8 


1 

9 

7 
6 

4 

8 

5 
3 
2 


2 

7 

8 

4 

5 
9 

6 
1 
3 


3 
8 
9 

5 

6 

7 

4 
2 
1 


4 
6 
2 
3 
9 
1 
8 
7 

5 


5 
4 
3 
1 

7 

2 

9 

8 

6 


6 

5 

1 

2 

8 

3 
7 
9 

4 


7 

1 

4 

9 

2 

6 

3 

5 

8 


8 

2 

5 
7 

3 

4 

1 

6 
9 


9 

3 
6 
8 
1 

5 

2 

4 
7 


E.  Sonneu'ann  has  found  the  follov;ing  d'^sign  for  t = 1 
by  mimicking  the  pattern  of  the  design  discovered  by  Mertz. 


1.  Personal  communication  to  A.  H. 
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Experimental  Units 


1 

2 

3 

4 

5 

6 

7 

8 

9 

10 

U 

12 

13 

14 

_1^ 

1 

1 

6 

11 

2 

3 

4 

5 

7 

8 

9 

10 

12 

13 

14 

15 

2 

3 

12 

6 

4 

5 

1 

2 

13 

14 

15 

11 

7 

8 

9 

10 

w 

3 

7 

14 

1 

8 

9 

10 

6 

15 

11 

12 

13 

2 

3 

4 

5 

1 

4 

15 

1 

7 

11 

12 

13 

14 

2 

3 

4 

5 

8 

9 

10 

6 

5 

8 

11 

3 

9 

10 

6 

7 

12 

13 

14 

15 

4 

5 

1 

2 

6 

9 

2 

12 

10 

6 

7 

8 

3 

4 

5 

1 

13 

14 

15 

11 

7 

11 

5 

8 

12 

13 

14 

15 

1 

2 

3 

4 

9 

10 

6 

7 

Periods  8 

12 

8 

5 

13 

14 

15 

11 

9 

10 

6 

7 

1 

2 

3 

4 

* 

9 

5 

10 

15 

1 

2 

3 

4 

6 

7 

8 

9 

14 

15 

11 

12 

ft 

10 

4 

15 

10 

5 

1 

2 

3 

11 

12 

13 

14 

6 

7 

8 

9 

■ \ 

11 

6 

13 

4 

7 

8 

9 

10 

14 

15 

11 

12 

5 

1 

2 

3 

1 

12 

10 

1 

3 

15 

6 

7 

8 

9 

4 

5 

1 

2 

11 

12 

13 

14 

ft 

13 

14 

4 

9 

15 

11 

12 

13 

5 

1 

2 

3 

10 

6 

7 

8 

14 

13 

9 

2 

14 

15 

11 

12 

10 

6 

7 

8 

3 

4 

5 

1 

\ 

15 

2 

7 

14 

3 

4 

5 

1 

8 

9 

10 

6 

15 

11 

12 

13 

I 

1 An  example  of  balanced  RM(21,21,2l)  is  given  in  Hedayat 


and  Afsarinejad  (1975).  An  example  of  balanced  RM(27,27,27) 
is  given  belov;.  The  group  theoretic  equivalent  structure  of 
the  following  design  was  first  discovered  by  Keedwell  (197^0* 
In  an  abstract,  Wang  (1973),  has  claimed  the  existence 
of  a certain  pattern  in  nonabelian  groups  of  orders  39,  55 
and  57  which  when  translated  to  our  set  up  implies  the  exist- 
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tence  of  balanced  RM(t,t,t)  designs  with  t = 59,  55  and  57. 
But  we  have  not  seen  this  announced  results.  No  other  pub- 
lished or  announced  results  are  known  to  nr,. 

The  story  of  balanced  RM(t,t,t)  design  with  t odd 
is  somewhat  discouraging  but,  as  we  shall  see  shortly,  such 
designs  exist  for  all  t if  X = 2. 

Family  Throe,  t = 2m  + 1,  X = 2. 

In  this  case  n = Xt  = 2(2m+l)  experimental  units. 
Partition  the  experimental  units  into  two  groups  each  of  size 
2m  + 1.  Number  the  periods  and  experimental  units  in  each 
group  by  0,1,... ,2m.  Then  d is  balanced  if  d assigns 
treatment  d(i,;j)  in  the  i-th  period  to  the  j-th  experi- 
mental unit  in  the  following  way: 

In  the  first  group: 


d(l,j)  = 

(^)  + J 

mod 

2mf  1 

if 

i 

is 

even. 

= 

(2nri-l  - + J 

mod 

2rfrt-l 

if 

i 

is 

odd. 

In  the  second  group: 

(m  - |)  + j 

mod 

2mf  1 

if 

i 

is 

even. 

(i+1  - m-1)  + J 

mod 

2m+l 

if 

i 

is 

odd. 

,g 
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